AD-A200  501 


m  w-E 00,3 

GAO 


United  States  General  Accounting  Office _ 

Report  to  the  Ranking  Minority  Member, 
Special  Committee  on  Aging,  U.S.  Senate 


FDA’S  REVIEWS  OF 
NEW  DRUGS 


Changes  Needed  in 
Process  for  Reviewing 
and  Reporting  on 
Clinical  Studies 


DTIC 


^ELECTE|* 
V  OCT  2  1 1988  B  I 

w  H  u 


ukruufuriON  STATEMENT  A 

Appro*  ad  for  pubflc  rate cbm; 
Dltrlbuflop  Uaiimltad 


GAO/HRD-88-lOO 


88  10  19  180 

I 

l 


GAO 


t 


United  States 

General  Accounting  Office 

Washington,  D.C.  20548 


Human  Resources  Division 

B-224063 

September  12,  1988 

The  Honorable  John  Heinz 
Ranking  Minority  Member 
Special  Committee  on  Aging 
United  States  Senate 

Dear  Senator  Heinz: 

This  report  responds  to  your  November  4,  1989,  request  that  we  review  activities  of  the 
Division  of  Scientific  Investigations  in  the  Food  and  Drug  Administration  (kda).  In  the  report, 
we  focus  on  the  need  for  coordinating  and  achieving  more  timely  reviews  of  clinical  studies 
submitted  to  kda  in  support  of  new  drug  applications.  The  report  recommends  steps  that  kda 
can  take  to  improve  its  coordination  and  performance  of  the  reviews. 

Unless  you  publicly  announce  its  contents  earlier,  we  plan  no  further  distribution  of  this 
report  until  30  days  from  the  date  of  this  letter.  At  that  time,  we  will  send  copies  to  the 
Secretary  of  Health  and  Human  Services,  the  Commissioner  of  kda.  the  Director  of  the  Office 
of  Management  and  Budget,  and  other  congressional  committees  and  interested  parties.  We 
also  will  make  copies  available  to  others  on  request . 

Sincerely  yours, 


Lawrence  H.  Thompson 
Assistant  Comptroller  General 


Executive  Summary 


Purpose 


Background 


uring  American  consumers  that  new  drugs  and  biologies  entering  the 
marketplace  are  safe  and  effective  is  a  responsibility  of  the  Food  and 
Drug  Administration  (fda).  Through  inspections  and  reviews,  fda’s  Divi¬ 
sion  of  Scientific  Investigations  attempts  to  verify  the  integrity  of  scien¬ 
tific  testing  and  the  reliability  of  test  data  submitted  to  fda  in  support  of 
new  drug  applications^-— _ _ _ _ 

In  November  19dC,  the  Chairman  (now  the  ranking  minority  member)  of 
the  Senate  Special  Committee  on  Aging  askecreAO-tiS rafc&wThe  Divi¬ 
sion’s  activities,  including  its  responsibilities  relating  to  the  approval  of 
new  drug  and  biologic  products;  the  accuracy  of  fda  data  and  adequacy 
of  oversight  regarding  clinical  investigators,  institutional  review  boards, 
and  toxicology  laboratories  involved  in  studies  supporting  new  drug 
applications;  fda's  review  of  studies  by  clinical  investigators  supporting 
new  drug  applications;  the  adequacy  and  timeliness  oPTor-caustr  (spe¬ 
cially  requested)  inspections;  and  enforcement  actions  resulting  from 
the  Division’s  work,  gao  also  examined  the  timeliness  of  the  Division’s 
inspections.  (  fi. 


Between  fiscal  years  1977  and  1987,  fda’s  Division  of  Scientific  Investi¬ 
gations  conducted  or  directed  more  than  5,400  inspections  and  reviews 
including  the  work  of  over  2,200  clinical  investigators,  almost  2,400 
institutional  review  boards,  and  over  500  toxicology  laboratories.  Dis¬ 
trict  office  field  staff  perform  most  inspections,  using  guidance  from  fda 
headquarters,  gao’s  examination  of  the  Division’s  work  was  done  before 
a  late  1987  reorganization  that  affected  some  of  its  responsibilities. 
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fda’s  computerized  listings  of  the  review  boards  and  toxicology  labora¬ 
tories  involved  in  studies  supporting  new  drug  applications  are  ade¬ 
quate  for  scheduling  inspections  of  these  entities.  It  has  had  problems 
maintaining  accurate  information  on  clinical  investigators,  but  has 
moved  to  improve  this. 

For  each  new  drug  application  submitted  to  fda,  the  general  policy  of 
the  Division  of  Scientific  Investigations  is  to  review  at  least  two  impor¬ 
tant  clinical  studies  supporting  it.  The  number  actually  reviewed  varies, 
however.  But  generally,  there  was  no  evidence  that  the  fda  officials  who 
determined  new  drug  safety  and  efficacy  considered  the  results  of  these 
reviews  and  the  Division’s  recommendations,  as  fda  policy  requires.  Bet¬ 
ter  communication  and  coordination  among  fda  units  would  help  ensure 
that  they  have  such  information. 
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Executive  Summary 


With  respect  to  for-cause  inspections  of  clinical  investigators  and  spon¬ 
sor/monitors,  Division  staff  often  participated.  But  their  participation 
had  little  effect  on  the  severity  of  violations  found.  For-cause  inspec¬ 
tions  performed  in  fiscal  years  1982-86  were  timely,  most  done  within  6 
months  of  being  assigned. 

The  reviews  of  clinical  studies  supporting  new  drug  applications  often 
lagged.  Of  190  reviews  scheduled  for  41  new  drugs  gao  examined,  less 
than  half  were  done  within  12  months  after  the  application  was  submit¬ 
ted.  At  the  time  of  gao’s  review,  kd.a  had  established  no  timeframes  for 
such  reviews,  even  though  in  May  1987  it  set  a  goal  of  reducing  to  12 
months  the  time  required  to  review  and  act  on  new  drug  applications. 


Principal  Findings 

gao  found  no  reason  to  believe  that  kda's  database  of  information  on 
review  boards  and  laboratories  was  not  sufficiently  accurate  and  com¬ 
plete  for  use  in  scheduling  inspections.  (See  p.  14.)  kda  has  had  problems 
maintaining  accurate  information  on  investigators,  but  has  moved  to 
improve  this.  As  of  July  1986,  fda  had  a  9-month  backlog  of  data  await¬ 
ing  entry  into  its  computerized  inventory  of  clinical  investigators.  But 
since  then,  it  has  increased  the  number  of  staff  who  maintain  the  data¬ 
base  and  changed  regulations  to  make  it  easier  for  staff  to  identify 
clinical  investigators.  Consequently,  the  backlog  has  been  eliminated 
and  the  database  is  more  reliable,  kda  officials  said. 


Improved  communication  and  interaction  between  the  Division  of  Scien¬ 
tific  Investigations  and  kda's  drug  review  divisions  would  provide 
greater  assurance  that  the  most  important  drug  studies  are  reviewed 
and  that  officials  who  review  new  drug  applications  are  aware  of  the 
results  of  the  Division's  reviews,  kda's  policy  manual,  which  gives  the 
drug  review  divisions  responsibility  for  selecting  studies  for  review,  is 
being  revised  to  assign  joint  responsibility  for  this  task  to  the  drug 
review  divisions  and  the  Division  of  Scientific  Investigations.  In  two 
drug  review  divisions,  gao  found  that  medical  officers  reviewing  new 
drug  applications  did  not  select  the  specific  studies  to  be  reviewed  nor 
coordinate  with  the  Division  in  the  selection.  In  only  27  of  190  instances 
examined  by  gao  were  review  results  documented  in  the  files  aecompa 
nying  the  applications.  (See  pp.  16-17.) 
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Studies:  Better 
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Information  on  Review 
Boards,  Laboratories, 
Investigators  Adequate 
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Division  Participation  Has 
Little  Effect  on  Results  of 
For-Cause  Inspections 


Timeliness  of  Inspections: 
Coordination  Within  FDA 
Often  a  Factor 


Over  the  past  10  years,  the  Division  of  Scientific  Investigation  has 
assigned  or  conducted  over  100  for-cause  inspections  of  clinical  investi¬ 
gators  and  sponsor/monitors.  1  sually.  these  are  done  because  the 
clinical  study  involved  is  of  particular  importance  to  a  new  drug  appli¬ 
cation,  some  wrongdoing  is  indicated,  or  the  investigator  is  conducting 
an  unusually  large  number  of  studies.  Of  181  such  inspections  during 
fiscal  years  1982-80.  Division  staff  directly  participated  along  with  dis¬ 
trict  investigators  in  124  (09  percent ).  "Official  action"  was  initiated  in 
10  percent  of  the  124  investigations,  voluntary  action  in  04  percent,  and 
no  action  in  20  percent.  These  results  are  quite  similar  to  results  for  the 
57  inspections  in  which  the  Division  did  not  participate.  Thus,  judging 
from  the  severity  of  findings,  lack  of  participation  by  the  Division  had 
little  effect  on  the  inspection  results.  However,  participation  by  Division 
staff  should  be  encouraged  so  that  the  staff  can  maintain  their  knowl¬ 
edge  about  particular  drugs  and  better  interact  with  the  drug  review 
divisions.  (See  pp.  24-20.) 


FDA  scheduled  199  reviews  of  studies  supporting  the  41  new  drug  appli¬ 
cations  oao  examined.  Fewer  than  half  of  these  (88)  were  completed 
within  12  months  of  foa's  receipt  of  the  application.  For  nearly  three- 
quarters  (73)  of  the  remainder.  Fl>.\  did  not  notify  its  district  offices  of 
the  need  to  make  reviews  until  at  least  1  year  after  it  received  the  appli¬ 
cation.  Coordination  problems  within  fda  contributed  to  increasing  the 
time  required  to  make  review  assignments  to  district  offices.  Once 
assigned,  however,  the  reviews  were  completed  in  a  timely  manner.  (Set' 
pp.  19-20.) 

But  Division  officials  told  oao  that  some  district  offices  were  having 
problems  completing  their  fiscal  year  1980  assignments.  Because  the 
cases  o.\o  first  examined  had  been  assigned  earlier  and  were  done  in  a 
timely  manner,  o  \o  selected  a  second  sample.  The  sample  covered 
clinical  investigator  reviews  assigned  in  fiscal  year  1980.  This  was  the 
most  recent  year  for  which  information  was  available.  Of  240  reviews 
completed  by  the  time  of  the  o.\o  review.  24  percent  were  done  within  3 
months  and  70  percent  within  0  months  of  the  date  assigned.  The 
remaining  30  percent  took  from  7  months  to  over  1  year.  District 
involvement  in  other  high  priority  work,  such  as  investigating  product¬ 
tampering  incidents,  was  cited  as  one  reason  for  delay  in  completing  the 
less  timely  assignments.  ( See  pp.  20-21.) 

Inspectors'  time  could  be  cut  in  half  and  a  significant  amount  of  clerical 
support  time  saved  on  inspection  reports,  district  office  officials  told 
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gao.  Because  some  long  inspection  reports  contain  few  if  any  adverse 
findings,  they  explained,  it  would  be  more  efficient  to  allow  abbreviated 
reports  to  be  made  where  there  was  substantial  compliance  with  fda 
requirements.  (See  p.  21.) 


Recommendations 


gao  is  making  several  recommendations  to  the  Secretary  of  Hits  to 
improve  the  scheduling  process  for  inspections  and  thus  help  fda  meet 
its  goals  for  processing  new  drug  applications  in  a  timely  fashion.  These 
include  ( 1 )  changing  the  present  quarterly  assignment  system  to  allow 
l  ending  clinical  investigator  inspection  assignments  to  district  offices  in 
a  more  timely  manner.  (2)  requiring  that  fda  include  a  statement  of  the 
results  of  inspections  by  the  Division  of  Scientific  Investigations,  with 
all  new  drug  application  packages  being  reviewed,  and  (3)  allowing  dis¬ 
trict  offices  to  write  abbreviated  inspection  reports  when  inspections 
are  in  substantial  compliance  with  fda  requirements.  (See  pp.  22-23.) 


11  11  ■ 

Agency  Comments 


mis  concurred  with  all  of  gad's  recommendations  and  pointed  out 
actions  it  was  taking  in  response  to  the  recommendations.  These  actions 
include  ( 1 )  revising  the  system  for  sending  inspection  assignments  to 
district  offices  so  that  they  are  sent  out  sooner,  ( 2 )  requiring  a  state¬ 
ment  in  new  drug  approval  decision  packages  on  the  results  of  the  Divi¬ 
sion's  inspections,  and  (3)  allowing  the  use  of  abbreviated  inspection 
reports  when  few  or  no  deficiencies  are  noted.  (See  pp.  30-33.) 
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Introduction 


Background 


In  evaluating  the  safety  and  effectiveness  of  new  drugs  and  biologies, 
the  Food  and  Drug  Administration  (fda)  relies  on  data  obtained  by 
clinical  investigators  who  conduct  studies  on  humans.  The  premature 
marketing  of  a  number  of  inadequately  tested  drugs  was  one  factor  that 
led  to  the  passage  of  the  Kefauver-Ilarris  Amendments  to  the  Federal 
Food.  Drug,  and  Cosmetic  Act  in  1992  and  to  fda's  promulgation  of 
Investigational  Drug  Regulations  in  1903.  These  amendments  and  regu¬ 
lations  required  fda  to  exorcise  greater  control  over  clinical  studies 
involving  human  test  subjects  to  assure  their  greater  protection  as  well 
as  the  integrity  and  reliability  of  the  studies. 


fda's  Division  of  Scientific  Investigations  (dsi)  (initially  known  as  the 
Scientific  Investigations  Staff)  was  formed  in  1907.  Its  primary  function 
was  to  investigate  the  work  of  clinical  investigators  suspected  of  per¬ 
forming  improper  research.  In  1985.  dsi  also  assumed  responsibility  for 
monitoring  studies  related  to  biologies.’ 

dm  Wac  Crated  in  ppVn  Center  for  Dm«>s  and  Biologies  until  late  1987. 
when  the  Center  became  two  separate  organizations— the  Center  for 
Drug  Evaluation  and  Research  and  the  Center  for  Biologies  Evaluation 
and  Research.  Each  new  organization  has  its  own  Office  of  Compliance, 
which  has  assumed  responsibility  for  the  bioresearch  monitoring  activi¬ 
ties  relating  to  its  respective  products,  dsi  became  a  division  in  the 
Center  for  Drug  Evaluation  and  RescdUli’i  Ouiu-  «»f  Compliance,  dsi 
responsibilities  relating  to  biologies  along  with  one  staff  person  were 
transferred  to  the  Center  for  Biologies  Evaluation  and  Research's  Office 
of  Compliance. 

In  carrying  out  its  monitoring  efforts,  dsi  is  responsible  for  maintaining 
close  working  relationships  with  fda's  six  drug  review  divisions  and 
conducts  or  directs  inspections  of  clinical  investigators,  institutional 
review  boards,  toxicology  (nonclinieal)  laboratories,  sponsor  monitors, 
and  radioactive  drug  research  committees.  The  purpose  of  those  inspec¬ 
tions  is  to  assure  the  integrity  of  the  scientific  testing  process,  the  relia¬ 
bility  of  test  data  submitted  to  fda.  and  the  protection  of  human  test 
subjects. 


A  biological  prodiiel  is  defined  m  rite  J’ubh<  Health  S*r\  n  e  Act  as  am  \  mis.  i  herapeuT jc  scrum 
toxin,  antitoxin,  vaccine.  hU k h  1 .  blood  <  oni|*oi,“nt  don\  ai  i\  <•  alfergem*  *  r*.du<  t .  analogous  produci 
applicable  to  the  prevention,  treatment,  or  '  tin  of  diseases  nr  injuries  of  man 

fairing  the  [teriod  covered  by  this  review.  KJ  t  \  pad  drug  re\  icu  do  isions  A  se\  ent b  dn  isjon  was 
established  in  .June  1PS7.  and  an  eighth  was  established  as  part  of  the  late  |!is7  reorganization 
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list  estimate's  t  hat  it  is  responsible  for  monitoring  t  ho  art  ivit  ios  of  as 
many  as  oO.OOO  individuals  and  organizations  involved  in  studies  sup¬ 
porting  new  drugs  and  I  before  HtHS)  biologies,  as  follows: 

•  Clinical  investigators,  usually  physicians  who  conduct  (he  clinical  stud¬ 
ies  of  new  drugs  and  biologies,  administer  t  he  test  products  to  pat  tents, 
and  report  t  he  results; 

•  Institutional  review  hoards,  made  up  of  both  medical  professionals  and 
citizens  from  the  community  and  formally  designated  by  an  institution 
to  approve  the  initiation  of.  and  conduct  periodic  reviews  of.  biomedical 
research  involving  humans,  paying  particular  attention  to  the  protection 
of  human  subjects: 

•  Toxicology  laboratories,  which  perform  preclude  al  (animal)  studies. 

•  Sponsor,  monitors,  generally  drug  firms  that  provide  funding  for  the 
testing  and  monitoring  of  clinical  studies  performed  by  investigators: 
and 

•  Radioactive  drug  research  committees,  associated  with  medical  institu¬ 
tions  or  with  a  committee  established  by  a  state  to  provide  advice  on 
radiation  health  matters  and  responsible  for  reviewing  and  approving 
the  use  of  radioactive  drugs  for  research  involving  human  subjects. 

Inspections  conducted  or  directed  by  nsi  are  of  two  kinds: 

•  Those  routinely  assigned  on  a  quarterly  basis  to  Kiev's  district  offices 
because  a  new  drug  application  ( \p.\ )  has  boon  submitted  to  fin  for 
approval.  Over  80  percent  of  inspections  01  ciinicai  investigators  are 
routine  and  performed  mostly  without  direct  ost  participation. 

•  For-cause  inspections,  which  involve  greater  participation  by  ost  staff, 
and  generally  are  performed  because  ( 1  )  the  dmg  review  div  ision  ques¬ 
tions  the  clinical  investigator's  data.  (2)  the  clinical  study  is  singularly 
important  in  the  approval  of  a  product.  (8 )  t hero  is  some  reason  to  sus¬ 
pect  that  the  clinical  investigator  is  not  doing  legitimate*  studies,  or  (  4 t  a 
clinical  investigator  is  conducting  an  unusually  large  number  of  studies, 
which  may  indicate  insufficient  attention  being  given  to  each  study 

I'nder  tin*  direction  of  the  Office  of  Regulatory  Affairs.  Kiev's  21  district 
offices  are  responsible*  for  performing  bioresearch  inspections  for  drugs 
and  biologie  s  according  to  standardized  ceimpliance  guidance*  provide'd 
by  fi *'  headquarters.  Noth  for-cause*  and  routine  inspections  are*  mn- 
elue  ted  by  district  office  investigators  specially  traine'd  to  elo  so.  psi 
staff,  who  serve  in  a  seientifie*  advisory  e  apae  ity  to  the*  elistrie  t  offnc 
investigators.  ofte*n  part icipate*  in  for-cause*  inspect  iems  because*  etf  i  heir 
subject  matter  knowledge*  about  the*  specific  drugs. 
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Between  fiscal  years  1977  and  1987.  nsi  conducted  or  directed  over 
5,400  inspections  of  clinical  investigators,  institutional  review  boards, 
toxicology  laboratories,  sponsor  monitors,  and  radioactive  drug  review 
committees  (see  app.  I ).  Since  fiscal  year  1980.  nsi  lias  averaged  573 
inspections  annually. 


In  a  1980  fact  sheet  developed  for  the  Chairman  of  the  Senate  Special 
Committee  on  Aging,  we  pointed  out  that,  although  nsfs  responsibilities 
had  increased,  ( 1 )  list  staff  devoted  to  bioresearch  monitoring  activities 
had  been  reduced  from  37  to  30  since  fiscal  year  1981  and  (2)  nsfs 
travel  funds  had  been  reduced  by  28  percent  between  fiscal  years  1983 
and  1980.  resulting  in  a  25-percent  decline  in  the  number  of  inspections 
in  which  the  staff  were  directly  involved.  In  view  of  kda's  resource 
reductions  for  nsi.  the  Chairman  ( now  ranking  minority  member) 
expressed  concern  about  nsfs  ability  to  carry  out  its  regulatory  respon¬ 
sibilities.  In  a  letter  of  November  4.  1980.  he  asked  that  we  review  nsfs 
activities  with  particular  emphasis  on  determining  the  following: 

1.  What  the  roles  and  responsibilities  of  nsi  and  fda  district  offices  are  in 
the  premarket  regulation  of  drug  and  biologic  products: 

2.  Whether  nsi  has  accurate  and  complete  information  on  active  clinical 
investigators,  institutional  review  boards,  and  toxicology  laboratories 
and  whether  its  oversight  over  these  entities  is  adequate: 

3.  What  kda's  policy  is  on  review  of  important  studies  submitted  by  drug 
and  biologies  firms  in  support  of  applications  for  product  approval: 

4.  Whether  all  important  studies  supporting  drugs  and  biologies 
approved  in  the  past  2  years  were  reviewed  by  nsi  prior  to  product 
approval: 

5.  Whether  kda’s  for-cause  inspections  are  adequate  and  timely:  and 

<).  What  enforcement  actions  kda  has  initiated  as  a  result  of  nsi  inspec¬ 
tions  in  each  year  since  nsi  was  established. 

To  accomplish  our  objectives,  wo  did  the  following: 


K<kk1  .mil  I  imy  Atiriiirii—r  rot  r<  in  KVsi  nin  ns  f, I  in  im.  hi  ■>(  n  kiiiiIi.  Iiu  i—r  iii.it  imp.  I  l.u  ••  IVrii 

H7-7iiT.  .-.f .  *TAr >  flkn  SiVfTtTTKs  AiiiT5>  ihsi; 


I’HKr  10 


U  AO  IIKO  SS  100  FUVs  Rexit-w.,<>rNi'tt  OniK' 


Chapter  1 
Introduction 


Reviewed  regulations  and  guidelines  governing  the  bit  (research  monitor¬ 
ing  program  and  the  drug  and  biologies'  approval  process. 

Interviewed  officials  in  ( 1  )  the  Center  for  Drugs  and  Biologies'  Office  of 
Compliance,  including  bsi.  (2t  the  drug  and  biologies  review  divisions, 
and  (3)  fda's  district  offices  in  Baltimore.  Dallas,  and  Los  Angeles. 
Reviewed  correspondence  and  other  records  related  to  the  inventories  of 
active  clinical  investigators,  institutional  review  boards,  and  toxicology 
laboratories.  We  interviewed  officials  responsible  for  compiling  and 
maintaining  the  inventories,  and  reviewed  measures  taken  to  improve 
their  completeness  and  accuracy. 

Determined  fda  policy  for  rev  iewing  important  studies,  and  selected  and 
reviewed  a  sample  of  new  drug  and  biologies  applications  approved  dur¬ 
ing  fiscal  years  1985  and  198(1  to  determine  whether  nsi  reviewed  the 
important  studies  supporting  product  approval. 

Reviewed  all  bioresearch  inspections  for  drugs  and  biologies  assigned  to 
fpa's  district  offices  in  fiscal  year  198(1  to  determine  the  time  required  to 
complete  these  assignments. 

Reviewed  and  analyzed  the  results  of  for-cause  inspections  completed  in 
fiscal  years  1982-8(1.  The  requester  was  concerned  about  the  adequacy 
of  such  inspections  because  on-site  bsi  staff  participation  in  them  had 
been  reduced.  We  sought  to  deU  rmine  ( 1 )  whether  direct  headquarters 
staff  participation  resulted  in  more  serious  violations  being  identified 
than  when  there  was  no  such  participation  and  (2)  whether  the  inspec¬ 
tions  were  completed  in  a  timely  manner.  We  did  not  review  the  fiscal 
year  1 J *87  inspections,  because  the  results  of  many  would  not  have  been 
finalized  when  we  were  performing  our  work.  Nor  did  we  attempt  to 
determine  the  technical  adequacy  of  individual  inspections,  as  we  lack 
the  scientific  expertise  to  do  so.  Information  was  not  available  to  deter¬ 
mine  the  relative  contributions  of  the  dsi  staff  person  and  the  district 
investigator  on  inspections  in  which  r»si  staff  participated. 

Obtained  and  reviewed  information  concerning  enforcement  actions  ini¬ 
tiated  by  fda. 

Of  202  drugs  and  biologies  fda  approved  in  fiscal  years  1985  and  1980. 
08  were  subject  to  dsi  review,  and  of  t  hose,  we  selected  a  sample  of  30 
for  our  review.  The  other  134  were  previously  marketed  drugs  being 
reviewed,  for  example,  for  new  uses  or  indications:  drugs  for  which 
then>  were  no  clinical  studies:  or  drugs  such  as  isotopes  and  insulin  not 
normally  reviewed  by  dsi  because  it  does  not  consider  them  important 
drugs.  We  focused  our  examinat  ion  on  drugs  (  1  )  where  nst  had  inspected 
two  or  fewer  studies  ( according  to  fda  )  and  ( 2 )  that  provided  a  cross 
section  of  work  performed  in  fda’s  drug  review  divisions.  We  also 
reviewed  5  drugs  from  the  134  that  normally  would  not  he  reviewed  by 
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dsi  to  verify  t hat  the  dsi  decision  not  to  review  clinical  studies  was 
appropriate.  Finally,  we  selected  ti  of  the  15  biologies  licensed  by  fda  in 
fiscal  years  1985  and  198b. 


This  report  covers  dsi  activities  prior  to  its  reorganization  in  late  1987. 
at  which  time  it  no  longer  had  responsibility  for  biologies.  Our  work, 
conducted  between  November  198b  and  September  1987.  with  addi¬ 
tional  information  obtained  through  April  1988,  was  done  in  accordance 
with  generally  accepted  government  auditing  standards. 
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dsi  needs  to  improve  its  timeliness  in  scheduling  and  completing  reviews 
of  clinical  investigators'  studies  and  the  communication  and  interaction 
between  dsi  and  the  drug  review  divisions.  Less  than  half  of  the  sched¬ 
uled  inspections  on  the  41  drugs  in  our  sample  were  completed  within  a 
year  of  the  date  the  new  drug  application  was  submitted  to  fda.  While 
fda  established  a  goal  in  May  1987  of  reducing  to  12  months  the  time  for 
acting  on  ndas,  it  has  not  established  goals  or  time  frames  for  completing 
inspections  prior  to  the  approval  of  an  nda.  kda  medical  officers  in  the 
drug  review  divisions  were  not  always  aware  of  dsi's  findings,  and  the 
inspection  results  were  not  required  to  be  included  in  the  package  of 
material  submitted  to  the  officials  responsible  for  approving  new  drugs. 


Procedures  for 
Selecting  Inspectees 
and  Studies  for 
Review 


Institutional  review  boards,  toxicology  laboratories,  and  radioactive 
drug  research  committees  are  inspected  on  a  cyclical  basis,  dsi  strives  to 
inspect  these  entities  every  2  to  3  years.  For  drugs,  dsi's  strategy  for 
selecting  clinical  investigators  for  inspection  is  tied  to  the  nda.  When  an 
nda  is  submitted  to  fda  for  approval  to  market  a  drug  product,  clinical 
studies  considered  important  to  the  approval  of  the  product  are  selected 
for  review  (for-cause  or  routine)  by  the  dsi  staff  or  through  consultation 
between  dsi  staff  and  medical  officers  responsible  for  reviewing  ndas. 
Responsibility  for  determining  such  important  studies,  according  to 
fda’s  Staff  Manual  Guide,  rests  with  the  appropriate  drug  review  divi¬ 
sion.  However,  a  change  in  that  guide,  in  the  final  stages  of  approval  as 
of  April  1988.  places  this  responsibility  jointly  on  dsi  and  the  drug 
review  division.  The  manual  had  gotten  out-of-date,  according  to  the 
Deputy  Director  of  dsi,  and  was  being  changed  to  reflect  actual  practice 

For  biologies,  prior  to  1985  clinical  studies  were  selected  for  review 
when  the  studies  were  completed,  whether  or  not  an  application  had 
been  submitted.  At  the  time  of  our  review,  dsi's  strategy  for  reviewing 
clinical  studies  involving  biologies  was  tied  to  the  licensing  application 
process  for  biologies.  (The  responsibility  for  biologies  shifted  from  dsi  in 
late  1987,  as  discussed  on  p.  8.) 
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fda  has  regulations  requiring  drug  sponsors  to  report  to  it  the  names  of 
clinical  investigators,  toxicology  laboratories,  and  institutional  review 
boards  used  in  studying  drugs,  fda  maintains  these  names  in  computer¬ 
ized  inventory  iistings  and  uses  the  inventories  of  review  boards  and 
laboratories  in  selecting  entities  for  inspection.  Our  review  of  correspon¬ 
dence  files  and  discussions  with  both  nsi  officials  and  inspection  offi¬ 
cials  in  fda's  district  offices  indicate  that  they  believed  the  inventories 
of  institutional  review  boards  and  toxicology  laboratories  were  suffi¬ 
ciently  complete  and  accurate  for  scheduling  inspections.  District  office 
officials  told  11s  they  rarely  discover  an  institutional  review  board  or 
laboratory  that  was  not  in  the  inventory.  While  we  did  not  indepen¬ 
dently  assess  the  accuracy  of  these  inventories,  we  have  no  reason  to 
believe,  from  our  discussions  with  dsi  and  district  office  officials  and 
our  review  of  correspondence  and  other  records  relating  to  the  invento¬ 
ries.  that  they  are  not  adequate. 

fda  uses  its  inventory  of  clinical  investigators,  which  includes  studies 
they  have  performed,  not  to  schedule  inspections  but  to  identify  other 
studies  by  an  investigator  whose  work  has  been  questioned,  fda  also 
may  use  the  inventory  to  schedule  additional  studies  for  review  or  to 
notify  sponsors  that  work  by  this  investigator  will  not  be  accepted  as  a 
basis  for  approving  new  drugs. 

In  the  past,  fda  had  problems  maintaining  an  accurate,  current  inven¬ 
tory  of  clinical  investigators.  As  of  July  198b.  according  to  a  Center  for 
Drugs  and  Biologies  official,  there  was  a  9-month  backlog  of  clinical 
investigator  data  awaiting  computer  entry.  Since  we  began  our  review, 
however,  fda  has  taken  steps  to  improve  the  accuracy  and  completeness 
of  the  clinical  investigator  database.  The  fda  regulations  were  changed 
to  make  it  easier  for  fda  staff  to  identify  clinical  investigators.  Also,  the 
Center  increased  the  number  of  staff  responsible  for  maintaining  the 
database.  Due  to  these  efforts,  dsi  officials  told  us.  the  backlog  has  been 
eliminated  and  the  database  is  now  much  more  reliable.  In  view  of  fda's 
actions  to  identify  and  correct  deficiencies  in  its  clinical  investigator 
inventory,  we  did  not  determine  whether  there  were  still  problems  with 
it. 


Accuracy  and 
Completeness  of  Data 
on  Clinical 
Investigators, 
Institutional  Review 
Boards,  and 
Laboratories 
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Oversight  of  Clinical 
Investigators,  Review 
Boards,  and 
Laboratories 


The  strategy  for  selecting  laboratories,  institutional  review  boards,  and 
clinical  investigators  for  review  and  inspection  as  discussed  on  page  13 
appears  appropriate  in  view  of  limited  kpa  resources  available  for 
reviewing  and  inspecting  such  entities.  We  concluded  this  after  discus¬ 
sions  w'ith  dsi  officials  but  we  did  not  verify  that  this  strategy  was 
always  being  followed. 


K 


Policy  for  Reviewing 
Important  Studies 
Supporting  New  Drug 
Applications 


dsi  reviews  the  work  done  by  approximately  200  to  300  clinical  investi¬ 
gators  annually.  Each  review  covers  one  or  more  clinical  studies  per¬ 
formed  by  these  investigators.  It  has  been  nsfs  policy  to  review  at  least 
two  important  clinical  studies  for  each  npa  submitted  to  kpa,  according 
to  dsi  officials. 

The  number  of  studies  reviewed  can  vary,  osi  told  us,  and  it  does  not 
inspect  every  important  study  supporting  an  npa.  If  a  drug  is  intended 
for  more  than  one  indication  (an  intended  use  of  the  drug,  as  stated  in 
the  npa),  dsi  selects  at  least  two  studies  for  each  indication,  according  to 
a  psi  official.  Thus,  for  a  drug  with  three  intended  uses,  psi  will  select  at 
least  six  studies  for  review.  In  addition,  if  an  npa  is  supported  by  a  large 
number  of  small  clinical  studies,  dsi  will  review  enough  studies  to  obtain 
an  adequate  number  of  patients  to  assure  that  the  studies  were  properly 
conducted. 


In  four  of  the  six  drug  review  divisions,  directors  and  medical  officers 
told  us  that  they  either  jointly  selected  the  clinical  investigators  for 
review  in  consultation  with  psi  or,  in  some  cases,  told  psi  which  investi¬ 
gators'  work  to  review.  In  the  two  remaining  divisions,  medical  officers 
did  not  select  the  studies  to  be  reviewed,  they  said,  nor  did  they  coordi¬ 
nate  with  psi  in  this  selection. 


After  psi  completes  its  analysis  of  clinical  investigator  review  findings, 
according  to  the  kpa  Staff  Manual  Guide,  it  recommends  to  the  drug 
review  divisions  what  actions  it  considers  appropriate  in  terms  of 
approving  the  drug.  The  drug  review  divisions  are  required  to  give  "due 
consideration"  to  these  recommendations  in  their  safety  and  efficacy 
determinations. 
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Communication  between  dsi  and  the  medical  officers  in  the  drug  review 
divisions  as  to  both  selection  of  studies  for  review  and  utilization  of 
results  should  be  improved.  Several  of  the  medical  officers  we  inter¬ 
viewed  said  they  did  not  select,  nor  coordinate  with  ns,  U<  select,  studies 
for  review.  Review  division  files  generally  did  not  include  results  of  nsi's 
reviews  of  studies,  although  dsi  records  show  that  copies  were  sent,  nor 
did  some  medical  officers  remember  being  informed  of  review  results. 

As  a  result,  the  method  of  selecting  studies  varied,  and  there  was  no 
assurance  that  the  most  important  studies  were  being  reviewed  or  that 
the  results  were  taken  into  consideration  in  the  decision  to  approve 
drugs  for  marketing. 

In  one  case,  dsi  scheduled  and  reviewed  17  clinical  studies  of  one  drug, 
yet  only  one  was  considered  important,  according  to  the  drug  review 
division.  The  medical  officer  responsible  for  reviewing  that  drug  for 
marketing  approval  did  not  know  why  nsi  reviewed  so  many  studies,  he 
said,  nor  why  they  chose  those  studies  to  review,  because  dsi  did  not 
consult  with  him.  The  dsi  staff  person  responsible  for  this  drug  is  no 
longer  with  the  agency.  Another  medical  officer,  who  had  been  review¬ 
ing  ndas  for  7  years,  told  us  he  would  not  release  an  nda  file  to  dsi 
because  he  did  not  know  who  dsi  was  or  what  responsibilities  it  had  in 
the  review  process. 

Once  a  review  is  completed,  the  district  office  submits  the  inspection 
report  to  dsi,  which  generally  sends  a  "classification  letter"  to  the 
inspectee.  This  letter  informs  the  inspectee  of  the  results  of  the  review, 
points  out  any  problem  areas  found  by  kda  inspectors,  and  outlines 
actions  kda  expects  the  inspectee  to  take  to  correct  the  problems.  To 
notify  the  review  divisions  of  the  results  of  each  review,  dsi  sends  copies 
of  each  classification  letter  to  ( 1 )  the  review  division,  (2)  the  responsible 
medical  officer,  and  (3)  the  nda  file.  Of  the  190  reviews  assigned  for  the 
drugs  in  our  sample,  however,  only  27  classification  letters  or  other 
written  evidence  of  the  results  of  the  reviews  were  in  the  nda  or  other 
files  maintained  by  the  drug  review  division  relating  to  that  nda. 

Some  medical  officers  did  not  remember  seeing  the  classification  letter. 
Although  some  medical  officers  advised  us  that  they  had  been  informed 
of  the  results  of  dsi  reviews  by  telephone,  we  found  no  documentation  of 
these  calls  in  the  nda  files.  Others  did  not  remember  being  informed  of 
the  results  of  dsi  reviews.  As  a  result,  wo  w’ere  unable  to  determine 
whether  division  directors  and  officials  of  the  Office  of  Drug  Research 
and  Review,  who  had  been  delegated  authority  for  approving  most 
drugs,  had  the  benefit  of  nsi’s  input  when  making  approval  decisions. 


Communication 
Between  DSI  Staff  and 
Medical  Officers  Needs 
Improvement 
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Although  the  drug  review  divisions  are  required  to  give  due  considera¬ 
tion  to  dsi’s  findings,  dsi  input  is  not  required  as  part  of  nda  decision 
packages.  The  Director  of  the  Office  of  Drug  Research  and  Review  told 
us  that  including  dsi’s  findings  in  the  decision  package  was  a  good  idea. 
There  was  often  some  mention  of  dsi's  input,  he  said,  but  only  two  of  the 
six  divisions  generally  included  the  results  of  dsi’s  review  in  the  pack¬ 
age.  He  also  told  us  that  the  information  forwarded  in  the  decision  pack¬ 
age  does  not  remain  intact  after  the  decision  is  made.  It  is  returned  to 
the  review  division  and  refiled  in  the  nda  file. 

Enforcement  Actions 
Initiated  as  Result  of 
DSI  Inspections 

About  2  percent  of  the  over  5,400  inspections  completed  by  dsi  between 
fiscal  years  1977  and  1987  resulted  in  regulatory  action  against  the 
inspectees  by  fda  (see  app.  II).  These  actions  included  disqualifying  or 
suspending  clinical  investigators,  disallowing  the  results  of  clinical  or 
laboratory  studies  in  support  of  ndas,  or  prosecution.  In  addition,  over 

60  percent  of  dsi’s  inspection  results  indicated  the  need  for  corrective 
action  by  the  inspected  entity.  These  actions,  considered  voluntary  by 
fda,  ranged  from  immediate  correction  of  minor  problems  that  could  be 
easily  handled  to,  in  the  most  serious  cases,  a  written  explanation  of 
actions  that  would  be  taken  to  correct  the  deficiencies  disclosed  during 
the  inspections. 

Since  1977,  dsi  inspections  have  resulted  in  the  disqualification,  suspen¬ 
sion,  or  restriction  of  70  clinical  investigators  for  fraudulent  or  poorly 
conducted  clinical  studies. 

DSI  Reviewed  Most 
Important  Studies 
Supporting  NDAs 

For  the  41  drugs  included  in  our  sample,  dsi  generally  scheduled  and 
completed  reviews  of  clinical  studies,  where  appropriate.  The  number  of 
reviews  that  dsi  scheduled  for  these  drugs  is  shown  in  table  2.1 . 

for  41  Drugs  in  GAO  Sample 

Reviews  scheduled  No.  of  drugs 

0  ~  ~  10 

1  6 

2  “  ‘  5 

3  or  more  20 

Total  41 
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For  only  1  of  the  10  drugs  where  no  reviews  were  scheduled  do  we 
believe — and  a  DS!  official  agreed — that  clinical  studies  should  have 
been  reviewed  before  approval.  When  the  nda  on  this  drug  was  origi¬ 
nally  submitted,  a  dsi  official  told  us.  the  district  offices  were  assigned 
to  review  a  selected  number  of  clinical  studies.  Subsequently,  the  nda 
was  withdrawn  by  the  sponsor,  however,  and  dsi  cancelled  the  reviews. 
When  the  nda  was  resubmitted  to  fda  it  "slipped  through  the  cracks," 
according  to  dsi.  As  to  the  other  nine,  dsi  did  not  schedule  clinical  inves¬ 
tigator  reviews  because: 

Four  drugs  were  previously  marketed  products  that  fda  already  had 
determined  to  be  safe  and  effective. 

Four  drugs  had  no  clinical  studies,  and 

One  drug  was  an  orphan  drug"1  with  one-patient  studies  not  conducive 
to  review. 

Of  the  six  drugs  that  had  only  one  review  scheduled: 

Three  had  only  one  important  clinical  study: 

One  had  only  one  other  important  clinical  study,  conducted  over  10 
years  earlier; 

One  had  one  review  scheduled  for  an  isotope,  a  class  of  drugs  that  under 
current  policy  dsi  normally  does  not  review  because  it  is  not  considered 
an  important  drug;  and 

One  had  been  marketed  previously,  but  dsi  believed  that  one  clinical 
study  should  be  reviewed,  because  the  nda  was  submitted  for  a  signifi¬ 
cantly  different  dosage  form 

For  each  of  three  drugs  in  our  sample,  at  least  two  reviews  were  sched¬ 
uled,  but  only  one  was  completed: 

For  one  drug,  the  district  office  responsible  for  the  reviews  could  not 
complete  the  assignments  prior  to  drug  approval  because  of  its  work¬ 
load.  Hence,  two  of  the  original  three  review  assignments  were  cancelled 
when  the  drug  was  approved. 

For  two  other  drugs,  the  district  office  attempted  but  could  not  complete 
one  of  two  scheduled  reviews.  This  can  occur  when  a  clinical  investiga¬ 
tor  is  no  longer  in  the  district,  the  clinical  investigator  dies,  or  the 
records  to  support  the  clinical  study  are  no  longer  available.  From  the 
dates  the  drugs  were  approved,  it  appears  dsi  had  sufficient  time  to 
assign  other  studies  supporting  the  safety  and  efficacy  of  these  drugs 


1 A  drug  for  a  ran1  <lisca.sc  or  condit  ion 
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Scheduling  and 
Completion  of  Reviews 
Needed 


for  review.  For  one  of  the  drugs,  dsi  could  not  explain  why  this  did  not 
occur;  for  the  other,  dsi  concluded  that  the  drug  was  of  minor  therapeu¬ 
tic  importance  and  that  only  one  of  the  two  scheduled  reviews  was 
needed. 

In  1985,  when  responsibility  for  biologies  was  transferred  to  dsi,  the 
procedure  for  selecting  important  clinical  studies  of  biologies  for  review 
was  changed  to  take  place  when  license  applications  were  submitted  to 
fda  for  approval.  Before  that,  review  assignments  were  made  when  indi¬ 
vidual  clinical  studies  appeared  sufficiently  complete  to  warrant  a 
review,  regardless  of  whether  an  application  had  been  submitted  to  fda. 
License  applications  for  the  six  biologies  we  reviewed  were  submitted  to 
flu  before  dsi  had  responsibility  for  reviewing  clinical  studies  of  biologic 
products.  For  these  six  applications,  at  least  two  clinical  studies  had 
been  reviewed  for  three  applications  and  only  one  review  had  been  com¬ 
pleted  for  one  other  application.  For  the  other  two  biologies,  we  could 
find  no  evidence  of  reviews  of  clinical  studies. 


In  A  Flan  For  Action,  Phase  II.  dated  May  1987.  fda  announced  a  pro¬ 
gram  to  improve  the  premarketing  evaluation  processes  for  drugs. 
According  to  the  plan.  3  years  after  the  recruitment  of  additional 
required  staff,  fda  should  be  able  to  complete  reviews  of  new  drug 
applications  in  an  average  of  12  months  compared  with  the  then  current 
average  of  27  months,  fda  has  requested  additional  staff  in  its  fiscal 
year  1989  budget. 

For  the  41  drugs  included  in  our  sample,  fda  scheduled  190  reviews. 
Only  88  (46  percent)  of  the  190  were  completed  within  1  year  of  the 
date  the  nda  was  submitted  to  fda.  For  73  of  the  remaining  102.  fda 
district  offices  were  not  notified  of  the  need  to  make  reviews  for  at  least 
1  year  after  receipt  of  the  nda.  For  four  drugs  in  our  sample,  routine 
reviews  of  clinical  investigator  studies  were  completed  after  the  drugs 
were  approved.  A  number  of  reasons  were  given  by  dsi  officials  fee-  the 
time  required  to  schedule  assignments.  They  advised  us  that  under  nor¬ 
mal  circumstances,  routine  assignments  cannot  be  made  to  the  district 
offices  in  less  than  two  quarters  (6  months)  after  the  date  the  nda  is 
received  by  fda  because  of  the  process  dsi  must  follow.  In  contrast,  for- 
cause  inspections  can  be  immediately  assigned. 

For  routine  inspections,  on  or  about  the  15th  of  each  month  dsi  receives 
a  list  of  ndas  received  by  fda  in  the  preceding  month.  Thus,  as  much  as 
6  weeks  could  elapse  before  dsi  becomes  aware  of  an  incoming  nda.  dsi 
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would  like  but  does  not  have  direct  access  to  fda's  computerized  man¬ 
agement  information  system  for  tracking  ndas.  a  psi  official  told  us. 
Moreover,  this  official  could  not  recall  if  such  access  had  been 
requested.  Direct  access  would  allow  list  to  he  aware  of  incoming  ndas  on 
a  current  basis.  Once  nsi  knows  of  an  nda.  it  generally  holds  discussions 
with  medical  officers  and  selects  studies  for  review.  Materials — some  of 
which  must  be  obtained  from  the  drug  sponsor — are  then  assembled  for 
the  assignment  package,  which  is  sent  to  the  district  offices  through  the1 
Office  of  Regulatory  Affairs.  That  office  requires  that  routine  assign¬ 
ments  be  submitted  (5  weeks  before  the  start  of  any  given  quarter,  nsi 
told  us.  The  time  is  needed  to  get  the  assignments  to  the  district  offices 
before  the  beginning  of  the  quarter,  according  to  an  Office  of  Regulatory 
Affairs  official. 

As  a  hypothetical  example,  if  an  nda  wore  submitted  to  fpa  on  Janu¬ 
ary  2,  dsi  would  not  be  aware  of  it  until  February  15.  It  then  would  need 
to  determine  which  clinical  studies  to  review.  As  assignments  must  be 
submitted  to  the  Office  of  Regulatory  Affairs  by  February  15  to  be 
scheduled  for  the  next  quarter,  the  best  dsi  could  do  would  be  to  include 
assignments  on  this  nda  on  the  list  to  be  submitted  by  May  15  for  carry¬ 
ing  out  in  the  period  July  through  September.  Consequently,  over  (i 
months  could  elapse  before  dsi  schedules  the  studies  for  review  by  the 
district  offices. 


Also,  the  district  offices  may  be  unable  to  complete  the  assignments 
within  the  period  assigned.  For  the  drugs  in  our  sample,  the  district 
offices  completed  (>8  percent  of  the  reviews  assigned  in  the  quarter  and 
an  additional  27  percent  in  the  next  quarter.  Many  of  the  reviews  in  our 
sample  had  been  assigned  to  the  district  offices  several  years  ago  and 
might  not  reflect  current  problems  with  completing  reviews. 

In  fiscal  year  198b.  dsi  officials  advised  us.  some  district  offices  were 
having  problems  completing  assignments.  This  was  true,  not  only  of 
reviews  of  drug  studies  by  clinical  investigators,  but  of  other 
bioresearch  monitoring  inspections  of  toxicological  laboratories,  institu¬ 
tional  review  boards,  and  sponsor /monitors.  For  that  reason,  we  deter¬ 
mined  the  inspection  dates  for  drug  and  biologies  assignments  sent  to 
the  district  offices  that  year.  At  the  time  of  our  review.  5(52  had  been 
completed.  About  27  percent  of  the  assignments  were  completed  in  the 
3-month  period  assigned  and  about  74  percent  within  b  months  (see 
table  2.2).  Inspections  of  clinical  investigators  were  completed  in  about 
the  same  time  as  other  bioresearch  inspections.  We  found  24  percent 
completed  in  the  3-month  period  assigned  and  70  percent  within  b 
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months,  with  30  percent  requiring  from  7  months  to  over  a  year  to 
complete. 


Table  2.2:  Time  to  Complete  Bioresearch 
Monitoring  Inspections  (Fiscal  Year  1986) 


Clinical 

investiqators 

Other 

inspections 

Total 

inspections 

Time  to  complete 

No. 

Percent 

No. 

Percent 

No. 

Percent 

Within  3  months 

57 

24 

92 

29 

149 

27 

Over  3-6  months 

111 

46 

156 

48 

267 

47 

Over  6  9  months 

42 

18 

49 

15 

91 

16 

Over  9  months- 1  year 

15 

6 

13 

4 

28 

5 

Over  1  year 

15 

6 

12 

4 

27 

5 

Totals 

240 

100 

322 

100 

562 

100 

For  our  review,  we  visited  three  district  offices  to  discuss  the 
bioresearch  monitoring  program.  The  three  districts  had  comparable 
clinical  investigator  workloads  in  fiscal  year  198(>.  Total  bioresearch 
monitoring  workload,  however,  varied  from  moderate  to  one  of  the  high¬ 
est  of  all  fda  districts.  District  officials  said  that  one  reason  they  did  not 
always  complete  assignments  in  a  more  timely  manner  was  because  they 
were  involved  in  higher  priority  work,  such  as  the  investigation  of 
product-tampering  incidents. 


Timeliness  could  be  improved  and  staff  time  significantly  reduced,  offi¬ 
cials  in  two  districts  told  us,  if  fda  permitted  abbreviated  inspection 
reports  when  no  major  problems  were  noted.  Nearly  half  of  the  inspec¬ 
tors'  time  and  a  significant  amount  of  clerical  support  time  go  into  pre¬ 
paring  a  detailed  report  of  the  inspection  results,  according  to  one 
district  official,  who  said  that  most  of  that  time  could  be  saved,  fda 
already  allows  abbreviated  reports  in  other  programs,  such  as  good 
manufacturing  practice  inspections,  if  no  problems  are  found  or  viola¬ 
tions  uncovered  are  minor.  Some  long  inspection  reports  we  reviewed 
contained  few,  if  any,  adverse  findings.  The  Office  of  Regulatory  Affairs 
was  considering  allowing  district  offices  to  prepare  abbreviated  reports 
for  bioresearch  inspections,  according  to  an  office  official. 


Conclusions 


More  timely  scheduling  and  completion  of  reviews  of  clinical  investiga¬ 
tors  would  provide  greater  assurance  that  the  clinical  studies  fda  uses 
as  a  basis  for  approving  drugs  are  valid.  Some  scheduled  reviews  were 
never  completed,  we  found,  and  others  were  completed  after  the  drug 
was  approved,  fda  lacks  goals  and  time  frames  for  completing  these 
reviews.  Because  of  possible  effects  the  reviews  of  a  clinical  investigator 
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can  have  on  the  approval  of  an  nda.  it  is  particularly  important  that 
these  reviews  be  completed  more  expeditiously.  This  is  especially  true  if 
fda  is  to  achieve  its  plan  for  action  on  spas  within  12  months,  yet  have 
the  results  of  these  reviews  considered  in  the  approval  decision.  Less 
than  half  of  the  reviews  scheduled  by  i>si  for  the  drugs  in  our  sample 
were  completed  within  12  months  of  the  date  fda  received  the  nda.  The 
principal  reason  was  the  time  taken  to  send  the  assignments  to  fda's 
district  offices.  Of  the  clinical  investigator  reviews  assigned  to  district 
offices  in  fiscal  year  198b,  30  percent  required  from  7  months  to  over  a 
year  to  complete  after  assignment. 

Giving  dsi  direct  access  to  information  on  incoming  npas.  revising  the 
method  of  scheduling  reviews,  and  allowing  abbreviated  reporting  for 
all  bioresearch  monitoring  inspections  when  inspect ees  are  in  substan¬ 
tial  compliance  should  improve  timeliness  and  conserve  inspection 
resources. 

In  addition,  communication  and  coordination  between  dsi  and  the  review 
divisions  should  be  improved.  Studies  to  be  reviewed  should  be  jointly 
selected  by  dsi  and  the  medical  officers,  fda  should  better  assure  that 
the  review  divisions  are  made  aware  of  the  inspection  results.  Copies  of 
classification  letters  frequently  were  not  in  the  nda  files,  and  there  was 
no  documentation  of  telephone  contacts. 

Finally,  dsi's  input  should  be  formally  documented  in  decision  packages 
for  drugs  approved  at  both  the  division  level  and  the  Office  of  Drug 
Research  and  Review  level.  Formal  disposition  of  problems  dsi  finds 
with  the  conduct  of  clinical  studies  also  should  be  documented  as  part  of 
the  nda  approval. 


Recommendations  to 
the  Secretary  of  HHS 


To  enable  fda  to  carry  out  its  bioresearch  monitoring  responsibilities  in 
a  more  timely  manner,  we  recommend  that  the  Secretary  of  mis  require 
the  Commissioner  of  fda  to 


•  finalize  procedures  in  the  Staff  Manual  Guide  for  selecting  clinical  stud¬ 
ies  for  review  and  include  provisions  for  communicating  the  results  to 
officials  responsible  for  reviewing  new  drug  applications. 

•  give  dsi  direct  access  to  fda's  automated  management  information  sys¬ 
tem  on  incoming  ndas  to  facilitate  inspection  scheduling. 

•  establish  goals  or  time  frames  for  scheduling  and  completion  of  inspec¬ 
tions  prior  to  the  approval  of  an  nda. 
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Agency  Comments 


change  the  current  quarterly  assignment  system  so  that  clinical  investi¬ 
gator  inspections  are  assigned  to  district  offices  in  a  more  timely 
manner. 

allow  district  offices  to  w  rite  abbreviated  inspection  reports  when 
inspectors  are  in  substantial  compliance  with  rb.\  requirements,  and 
require  that  a  statement  concerning  the  results  of  list's  inspections  be 
included  in  all  new  drug  application  approval  packages  and  that  inspec¬ 
tion  classification  letters  be  included  in  the  m»a  file. 


By  letter  dated  July  28.  1988.  mis  concurred  with  all  our  recommenda¬ 
tions  (see  app.  Ill )  and  pointed  out  actions  it  was  taking  in  response  to 
t lie  recommendations.  SjM'cifically.  I  P\  stated  that  it 

has  finalized  the  Staff  Manual  (iuido.  which  was  to  be  issued  by 
August  til.  1988: 

has  given  indirect  access  to  its  automated  management  information 
system  on  new  drug  applications  and  is  expanding  these  capabilit ies 
with  the  planned  acquisition  of  additional  equipment : 
is  evaluating  the  current  activity  for  scheduling  and  completing  inspec¬ 
tions  to  determine  appropriate  goals  and  time  frames; 
has  changed  the  system  of  scheduling  inspections,  beginning  with  the 
fourth  quarter  of  fiscal  year  1988.  by  providing  that  all  biorosoarch 
inspection  assignments  will  be  sent  directly  to  the  affected  district  office 
and  making  assignments  immediately  rather  than  waiting  until  the  end 
of  the  quarter; 

has  already  implemented  abbreviated  reporting  for  inspections  of  insti¬ 
tutional  review  boards  and  will  incorporate  the  criteria  for  abbreviated 
reporting  on  inspections  of  clinical  investigators  into  its  fiscal  year  1989 
bioresearch  monitoring  compliance  programs  and 

will  issue  the  appropriate  policy  statement  to  require  the  results  of  list's 
inspections  to  become  part  of  all  new  drug  application  decision  packages 
and  inspection  classification  letters  to  become  part  of  the  M>.\  file.  In 
cases  where  no  nst  inspections  were  conducted,  the  decision  packages 
will  include  a  notation  that  the  application  was  not  subject  to  psi 
inspection. 
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Whether  or  not  staff  of  the  Division  of  Scientific  Investigations  directly 
participated  in  for -cause  reviews  and  inspections  of  clinical  investiga¬ 
tors  and  sjtonsor  monitors  made  little  difference  in  the  results,  our 
review  of  such  insjiections  done  between  fiscal  years  1982  through  1  98(1 
showed.  Thus,  there  appears  to  he  little  reason  for  concern  over  cases  in 
which  psi  staff  are  unable  to  directly  participate.  Of  for-cause  inspec- 
tions  for  which  such  information  was  available.  ti4  percent  were  com¬ 
pleted  in  thed-inonth  period  assigned  and  97  percent  within  (i  months. 

<  her  the  past  10  years,  osi  has  assigned  or  conducted  over  400  for-cause 
inspections  of  <  linical  investigators  and  sponsor  monitors.  As  explained 
on  paged,  for-cause  insjieet ions  typically  are  performed  because  a 
clinical  study  is  of  particular  importance  to  an  \m  approval,  there  is 
some  indication  of  wrongdoing,  or  a  clinical  invest  igator  is  conduct  mg 
an  unusually  large  number  of  studies.  A  osi  headquarters  staff  person  is 
assigned  resjionsihility  for  the  inspection  and  often  participates  as  part 
of  the  inspection  team.  There  is  no  particular  criteria  for  whether  a  psi 
staff  member  should  take  part  in  an  inspection,  a  i»si  official  explain*  d. 
Participation  dependson  a  number  of  factors  including  the  work  sched¬ 
ule  of  the  l >si  staff  person  and  the  assigned  district  investigator,  list's 
"comfort  level"  with  having  district  investigators  perform  the  inspec¬ 
tion  without  psi  participation,  the  official  said,  depends  on  the  capabil¬ 
ity  of  the  individual  investigator. 


In  fiscal  years  1982-87).  psi  staff  participated  on  average  in  about  74 
percent  of  the  194  inspections  conducted.  In  fiscal  year  198(1.  however. 
psi  directly  participated  in  only  5:1  percent  of  47  inspect  ions  conducted 
A  psi  official  told  us  that  this  was  due  to  decreased  resources  and  travel 
funds.  In  fiscal  year  1987.  however,  psi  participation  rose  to  71  percent 
of  48  inspections.  A  psi  official  explained  that  there  was  less  pressure  in 
fiscal  year  1987  to  not  expend  travel  funds  than  in  fiscal  year  198(1 


Violation  Findings  No 
More  Serious  When 
DSI  Staff  Participated 


To  determine  if  there  was  a  significant  difference  in  the  results  when  psi 
staff  wore  part  of  the  inspection  team,  wo  analyzed  the  results  (classifi¬ 
cation  )  of  all  for cause  clinical  investigator  and  sponsor  monitor  inspec¬ 
tions  conducted  during  fiscal  years  1982-8(1.  Participation  by  psi  staff, 
because  of  their  expertise  and  particular  knowledge  of  the  drugs,  might 
make  a  difference  in  inspection  findings  and  types  of  actions  recom¬ 
mended;  thus  we  list'd  the  severity  of  the  classification  of  inspection 
results  as  criteria  Of  the  181  for-cause  inspections  conducted  during  the 
period,  psi  staff  directly  participated  in  124.  or  (19  percent.  An  analysis 
of  the  results  showed  lit t It'  difference  in  the  severity  of  violations  found 
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Table  3.1:  DSI  Participation  in  For-Cause 
Inspections  i Fiscal  Years  1982-86) 


and  types  of  actions  recommended  when  nsi  staff  participated  and  wlten 
they  did  not. 

Of  the  124  inspections  in  which  nsi  participated.  lb  percent  were  classi¬ 
fied  "official  action  indicated."  (14  percent  as  "voluntary  action  indi¬ 
cated"  (violations  ranging  from  minor  oversights  to  those  requiring  a 
written  action  plan  of  corrective  measures),  and  20  percent  as  "no 
action  indicated"  (inspector*  in  compliance)  (see  table  3.1 ).  This  com¬ 
pares  closely  to  19.  oh.  and  23  percent  in  these  categories,  respectively, 
for  the  57  inspections  in  which  osi  did  not  participate. 


No  DSI 


DSI  participation 

participation 

Total 

Classification 

No. 

Percent 

No. 

Percent 

No. 

Percent 

Official  actios  indicated 

20 

16 

11 

19 

31 

17 

Voluntary  action  indicated 

79 

64 

32 

56 

1 1 1 

61 

No  action  indicated 

25 

20 

13 

f_3 

38 

21 

Other 

0 

1 

2 

1 

i 

Totals 

124 

100 

57 

100 

181 

100 

kda  further  divided  most  of  the  inspection  results  classifier  as  "volun¬ 
tary  action  indicated"  into  subcategories.  Kvon  within  this  category,  the 
violations  were  about  the  same  when  usi  staff  participated  and  when 
they  did  not.  Overall,  nsi  participated  in  79  (71  percent )  of  the  1 1 1 
inspections  where  voluntary  action  was  indicated.  They  took  part  in  73 
percent  of  the  inspections  in  the  most  serious  subclassification  and  72 
percent  of  the  less  serious. 

Most  directors  of  Fn.Vs  tii  ug  review  divisions  believed  they  lacked  a 
basis  to  comment  on  the  district  offices'  ability  to  conduct  inspections. 
Hut  one  told  us.  when  asked  his  "comfort  level"  with  the  inspections, 
that  nst  staff  are  needed  for  the  scientific  aspects  of  clinical  studies 
because  of  their  scientific  expertise,  nsi  believes  that  its  staff  bring  to 
the  inspection  team  both  added  expertise  and  a  broader  knowledge  of  all 
of  the  inspection  activity  on  any  given  drug. 

According  to  officials  in  the  three  district  offices  we  visited,  nsi  added 
scientific  expertise  and  brought  some  additional  insight  on  each  drug  to 
the  inspection  team.  Only  one  official,  however,  thought  that  nsi  should 
be  present  during  the  inspection. 
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Officials  in  two  districts  told  us  that  coordinating  the  assigned  district 
inspector's  schedule  with  nsi  and  the  clinical  investigator  or  sponsor 
monitor  to  be  inspected  sometimes  was  a  problem  and  lengthened  the 
time  needed  to  complete  inspections. 


Conclusions 


usi  staff  may  bring  additional  expertise  and  a  broader  perspective  to  the 
inspection  team.  Hut  our  analysis  of  for-cause  clinical  investigator  and 
sponsor/ monitor  inspections  in  fiscal  years  1982-80  showed  that  there 
was  little  difference  in  the  severity  of  the  findings  whether  nsi  staff  par¬ 
ticipated  in  the  inspection  or  not.  Thus,  there  appears  to  be  little  reason 
for  concern  in  those  cases  in  which  nsi  staff  are  unable  to  participate. 
Participation  by  nsi  staff,  however,  should  be  encouraged  so  they  can 
maintain  their  knowledge  about  particular  drugs  and  better  interact 
with  medical  officers  in  the  drug  review  divisions.  A  majority  of  for- 
cause  inspections  during  this  period  were  completed  in  the  period 
assigned  and  almost  all  were  completed  within  <i  months. 
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Bioresearch  Inspections  Completed  by  FDA 
(Fiscal  Years  1977-87) 


Subject  of  inspection3 _ 

Radioactive 


Fiscal  year 

Clinical  investiqators 
For-cause  Routine 

Sponsor/ 

monitors 

Laboratories 

Institutional 

review 

boards 

drug 

research 

committees 

Totals 

1977 

4 

36 

b 

0 

101 

0 

141 

1978 

32 

33 

b 

0 

220 

0 

285 

1979 

63 

146 

b 

6 

225 

15 

455 

1980 

57 

235 

b 

54 

256 

27 

629 

1981 

42 

225 

b 

58 

240 

25 

590 

1982 

18 

179 

19 

59 

210 

21 

506 

1983 

40 

187 

17 

59 

246 

20 

569 

1984 

29 

222 

18 

81 

241 

19 

610 

1985 

39 

171 

19 

69 

230 

20 

548 

1986 

45 

164 

26 

80 

206 

18 

539 

1987 

36 

229 

17 

81 

212 

17 

592c 

Totals 

405 

1,827 

116 

547 

2,387 

182 

5,464 

Numbers  do  no!  include  inspections  attempted  but  not  completed 

■  Sponsor; monitor  inspections  were  included  m  clinical  investigator  inspections  until  tisoal  ,eai  1982' 

Does  not  inc'ude  3  laboratory  2?  institutional  review  board  and  1  '"■dioactive  drug  research  committee 
inspections  not  classified  as  ol  January  1988 
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Classification  of  Bioresearch  Inspections 
(Fiscal  Years  1977-87) 


Classification  of  inspection  results 

Fiscal  year 

Official 

action 

Voluntary 

action 

Other 

No  action 

Totals 

1977 

2 

50 

0 

89 

141 

1978 

12 

67 

2 

204 

285 

1979 

24 

144 

6 

281 

455 

1980 

10 

230 

2 

387 

629 

1981 

14 

254 

3 

319 

590 

1982 

5 

381 

0 

120 

506 

1983 

11 

453 

0 

105 

569 

1984 

9 

471 

0 

130 

610 

1985 

8 

467 

1 

72 

548 

1986 

11 

438 

0 

90 

539 

1987 

12 

454 

0 

126 

592 

Totals 

118 

3,409 

14 

1,923 

5,464 

Percent 

22 

62  4 

2 
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Comments  From  the  Department  of  Health  and 
Human  Services 


> 

■ 
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DEPARTMENT  OF  HEALTH  &  HUMAN  SERVICES 


Office  of  Inspector  General 


Washington  D  C  2C2C^ 


JUL  2  8  1988 


Me.  Lawrence  H.  Thompson 
Assistant  Comptroller  General 
U.S.  General  Accounting  Office 
Washington,  D.C.  20548 

Dear  Mr.  Thompson: 

Enclosed  are  the  Department's  comments  on  your  draft  report, 
"FDA's  Reviews  of  New  Drugs:  Changes  Needed  in  Process  for 
Reviewing  and  Reporting  on  Clinical  Studies."  The  enclosed 
comments  represent  the  tentative  position  of  the  Department  and 
are  subject  to  reevaiuation  when  the  final  version  of  this  report 
is  received. 

The  Department  appreciates  the  opportunity  to  comment  on  this 
draft  report  before  its  publication. 


Sincerely  yours, 


Richard  P.  Kusserow 
Inspector  General 
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COMMENTS  OF  THE  DEPARTMENT  OF  HEALTH  AND  HUMAN  SERVICES 
ON  THE  GENERAL  ACCOUNTING  OFFICE  DRAFT  REPORT.  "FDA'S  REVIEWS  OF 
NEW  DRUGS:  CHANGES  NEEDED  IN  PROCESS  FOB  REVIEWING  AND  REPORTING 
ON  CLINICAL  STUDIES''  REPORT  NO.  HRD-88-100.  JUNE  12M 

We  appreciate  the  opportunity  to  review  the  draft  report. 
Generally,  we  find  it  to  be  accurate  and  fair.  We  have  the 
following  comments  with  regard  to  the  recommendations. 

GAO  Becommendat i°n 

To  enable  FDA  to  carry  out  Its  bioresearch  monitoring 
responsibilities  in  a  more  timely  manner,  GAO  recommends  that  the 
Secretary  of  HHS  require  the  Commissioner  of  FDA  to: 

Finalise  the  Staff  Manual  Guide  establishing  procedures  for 
selecting  clinical  studies  for  review  and  include  provisions 
in  the  guide  for  communicating  the  results  of  the 
inspections  to  the  officials  responsible  for  reviewing  new 
drug  applications. 

Department  Comment. 

We  concur.  The  Staff  Manual  Guide  has  been  finalized  and  will  be 
issued  to  FDA  reviewing  divisions  by  August  31. 

Provide  DS I  direct  access  to  FDA  's  automated  management 
Information  system  on  incoming  NDA's  to  facilitate  the 
inspection  scheduling  process. 

Department  Comment 

We  concur.  The  Division  of  Scientific  Investigations  fDSI),  FDA, 
currently  has  the  capability  to  directly  access  FDA's  automated 
management  information  system  (MIS)  on  new  drug  applications 
(NDA).  This  capability  is  being  expanded,  with  the  planned 
acquisition  of  additional  microcomputers,  modems,  and  high-speed 
equipment  for  accessibility  and  dissemination  of  data. 

As  noted  by  GAO,  the  NDA  reviewing  divisions  currently 
participate  in  identifying  specific  clinical  trials  that  need  to 
be  inspected.  This  can  only  be  done  after  at  least  a  preliminary 
review  of  the  application  has  been  done  and  decisions  reached 
about  which  studies  are  pivotal,  whether  the  data  appear  to  be 
valid,  the  significance  of  the  new  drug,  and  other  similar 
factors.  Furthermore,  some  30  to  40  percent  of  applications 
received  do  not  reach  approval  for  reasons  other  than  those 
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as  so-'  isted  u;t.h  inspections  of  clinical  investigations  We 
believe  the  practice  of  involving  reviewing  decisions  in  tne 
dec  is  ion- making  is  necessary  and  will  continue  to  do  so  This 

wii)  reduce  the  impact  of  direct  MIS  access  on  scheduling 
inspections . 

GA 0  Recommendation 

Establish  goals  or  timeframes  for  when  inspections  should  be 
scheduled  and  completed  prior  to  the  approval  cf  an  NDA. 

Department  i  Y. mme  n t 

We  concur  Tne  EDA  is  evaluating  the  current  activity  to 
determine  the  appropriate  goals  and  time  frames  for  scheduling 
and  completing  inspections  of  clinical  investigators.  It  should 
be  noted,  however,  that  completion  of  inspections  has  not  been  a 
controlling  factor  in  the  time  required  for  new  drug  reviews.  In 
most  cases,  the  inspections  have  been  completed  well  before  a 
final  decision  was  made  regarding  the  new  drug  application.  As 
efforts  to  reduce  review  time  are  achieved,  FDA  will  continue  to 
monitor  closely  the  scheduling  of  inspections  to  assure  that  they 
do  not  impede  the  progress  of  new  drug  reviews. 

Further,  it  should  be  noted  that  goals  and  time  frames  will 
always  have  to  be  sufficiently  flexible  to  accommodate  critical 
human  safety  priorities  performed  by  FDA  district  offices, 
particularly  emergencies  such  as  product  tampering,  life- 
threatening  product  contamination  Incidents,  and  other  similar 
events . 

GAO  Recommendation 

Change  the  present  quarterly  assignment  system  to  allow 
sending  clinical  Investigator  inspection  assignments  to 
district  offices  in  a  more  timely  manner. 

Department  Comment 

We  concur.  Beginning  with  the  fourth  quarter  of 

Fiscal  Year  (FY)  19BB.  all  Inspection  assignments  regarding  FDA  s 
bioresearch  monitoring  program  will  be  sent  directly  to  the 
affected  district  office  rather  than  being  routed  through  FDA's 
Office  of  Regional  Operations  (0R0)  at  headquarters.  At  the  same 
time,  assignments  will  be  issued  Immediately  rather  than  waiting 
until  the  end  of  the  quarter  as  was  the  previous  practice.  In 
order  to  preserve  management  oversight  of  the  program.  0R0  will 
also  receive  electronic  notification  of  the  assignments. 
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GAO  Secommeniation 

Allow  district  off:  ~<ss  t«.  writ-  abbreviated  inspection 
reports  when  inspectees  are  in  substantial  compliance  with 
FDA  requirements. 


CeEartmeut  Comment. 


We  concur.  FDA  has  already  Implemented  a  procedure  for 
inspections  of  institutional  review  hoards  and  will  incorporate 
the  criteria  for  abbreviated  reporting  on  inspections  of  clinical 
investigations  into  the  FY  1989  b i '•■res e a rc h  monitoring  compliance 
programs  for  district  offices 


Require  that  a  statement  concerning  the  results  of  DSI's 
inspections  become  part  of  all  new  drug  application  approval 
packages  and  that  inspection  classification  letters  become 
part  of  the  NDA  file. 

Department  Comment 

We  concur.  FDA  will  issue  the  appropriate  policy  statement; 
however,  not  ail  NDA's  are  subject  to  DS I  review.  This  was 
acknowledged  by  GAO  in  their  review  of  FYs  1985  and  1986  NDA 
approvals  (page  16  of  the  draft  report).  Applications  for  which 
no  DS I  inspections  were  conducted  would  not  be  affected  by 
implementation  of  this  recommendation.  For  these  applications, 
the  NDA  approval  packages  and  files  will  include  a  notation  that 
the  applications  were  not  subject  to  DS I  inspections. 


i 
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